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WORKING PAPER 


Mounting evidence demonstrates that social-emotional skills are 
important for students’ academic and life success, yet we have 
limited evidence on how these skills develop over time and how 
this development varies across student subgroups. In this study, 
we use the first large-scale panel survey of social-emotional 
learning (SEL) to describe how four SEL 
constructs—growth-mindset, self-efficacy, self-management, and 
social awareness—develop from Grade 4 to Grade 12, and how 
these trends vary by gender, socioeconomic status, and 
race/ethnicity. Our results are based on self-report student surveys 
administered in the 2014-15 and 2015-16 school years to roughly 
400,000 students within the CORE districts, a network of urban 
school districts in California. We simulate cohort trends for students 
continuously enrolled in six districts within CORE by adding the 
mean change at each grade level observed among students 
surveyed in both years to the mean scores of Grade 8 students in 
2015-16. We find that, with the exception of growth mindset, 
social-emotional skills do not increase monotonically as students 
move through school. Self-efficacy, social awareness, and to a 
lesser degree self-management decrease after Grade 6. Trends in 
SEL also vary by subgroup. Female students report higher 
self-management and social awareness than boys, but their 
self-efficacy drops sharply relative to boys in middle and high 
school. Economically disadvantaged students report lower levels 
of each social-emotional construct, but gaps in self-management, 
growth mindset, and self-efficacy narrow in high school. White 
students report higher levels of social-emotional skills than African 
American and Latinx students; Asian students report levels of 
self-management similar to White students but exhibit declining 
self-efficacy over time. While our findings cannot be generalized 
beyond the California districts we study, the scope and scale of our 
data far exceeds anything in the extant literature. 


This paper was produced as part of the CORE-PACE Research Partnership, which is focused on producing research that informs 
continuous improvement in the CORE districts (Fresno, Garden Grove, Long Beach, Los Angeles, Oakland, Sacramento City, San 
Francisco, and Santa Ana unified school districts) and policy and practice in California and beyond. We thank the leaders and 
administrators in the CORE districts for their support throughout this project, and the generous funder of this research, the Walton 
Family Foundation. PACE working papers are circulated for discussion and comment purposes and have not undergone the 
peer-review process that accompanies official PACE publications. 
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Student skills that are not captured by tests of academic achievement and ability predict 
a range of academic and life outcomes (Almlund, Duckworth, Heckman, & Kautz, 2011; 
Heckman, Humphries, & Kautz, 2014; Deming, 2017). Both intrapersonal skills (such as the 
ability to regulate one’s behavior in pursuit of long-term goals) and interpersonal skills (such as 
the ability to collaborate with others) appear to be key complements to cognitive ability in 
determining students’ success in school, post-secondary education, and the labor market 
(National Research Council, 2012). In addition, such “non-cognitive” or “social-emotional” skills 
may be more malleable in school settings than cognitive abilities, making them attractive 
targets for interventions aimed at improving student success (Cunha & Heckman, 2008; Dee & 
West, 2011; Heckman & Kautz, 2013). Consistent with this logic, a recent meta-analysis finds 
that school-wide interventions targeting social-emotional learning (SEL) generate 
improvements in students’ academic achievement (Durlak, Dymnicki, Taylor, Weissberg, & 
Schellinger, 2011). 


Accumulating evidence on the importance of non-tested skills has led policymakers to 
look beyond test scores when seeking to measure and improve student outcomes. The recently 
enacted federal Every Student Succeeds Act (ESSA), for example, requires states to incorporate 
an “additional indicator of school quality or student success” not based on math and reading 
test scores into their school accountability systems. A growing number of states have 
established standards for SEL or incorporated social-emotional skills into their academic 
content standards (Dusenbury et al., 2015). Meanwhile, the Aspen Institute has launched a 
National Commission on Social, Emotional, and Academic Development with a mandate to “re- 
envision what constitutes success in our schools” and “explore how schools can fully integrate 
social, emotional, and academic development to support the whole student.”? 


At the forefront of this trend are the CORE districts, a network of large urban districts in 
California serving nearly one million students. These districts received a waiver from the U.S. 
Department of Education in 2013 to implement an alternative to the school accountability 
system then-mandated under the No Child Left Behind Act.* The CORE districts used this 
flexibility to develop a measurement system that includes survey-based measures of SEL and 
school culture and climate alongside traditional academic indicators. Although the obligation to 
use its SEL survey for school accountability was voided by the 2015 enactment of ESSA, the 
CORE districts continue to collect data on SEL to guide school policy and continuous 
improvement. 


The CORE districts’ ongoing partnership provides a unique opportunity to inform efforts 
to promote SEL with evidence on how key social-emotional skills develop as students progress 
through American schools. Policymakers need to know how social-emotional skills typically vary 
across grade levels and subgroups in order to interpret aggregate data on SEL and determine 


' https://www.aspeninstitute.org/programs/national-commission-on-social-emotional-and-academic- 
development/ 

> The CORE districts that implemented the waiver are Fresno, Long Beach, Los Angeles, Oakland, San Francisco, 
and Santa Ana unified school districts. Garden Grove and Sacramento City unified school districts are also part of 
the CORE network. 
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where interventions or supports are most needed. Similarly, educators need such information 
in order to interpret data on their own students and take appropriate action. In some cases, 
evidence of trends in SEL has already informed the design of interventions. For example, 
evidence that many students experience a decline in self-esteem and school engagement as 
they move from elementary school to middle school (Blum & Libbey, 2004; Eccles, Lord, & 
Midgley, 1991; Eccles, Wigfield, Midgley, & Reuman, 1993) has motivated the development of 
SEL-focused interventions aimed at supporting students’ through this transition (see, e.g., 
Blackwell, Trzesniewski, and Dweck, 2007). 


However, there is a lack of research examining how a broader set of social-emotional 
skills develop over time, particularly for different student subgroups. Existing studies with a 
longitudinal design tend to focus on the development of SEL only in early childhood or 
elementary school (e.g., Edossa, Schroders, Weinert, & Artelt, 2018; Rothbart, Posner, & Kieras, 
2006) or consider only a single SEL construct (Ross & Tolan, 2017). Cross-sectional studies in 
turn do not shed light on how skills evolve over time (e.g., Ablard & Lipschultz, 1998; Chodhury 
et al., 2012). Many studies of SEL rely on small convenience samples of students within specific 
settings (e.g., Duckworth, Tsukayama, & May, 2010; Blackwell et al., 2007), raising questions 
about the generalizability of their findings. Moreover, variation in the specific constructs and 
measures used to assess students’ social-emotional skills makes it difficult to compare results 
across studies (e.g., Berg et al., 2017; Duncan & Magnuson, 2011). 


In this paper, we use the CORE districts’ unique SEL survey to address two broad 
questions: How do the four SEL constructs assessed by that survey—growth mindset, self- 
efficacy, self-management, and social awareness—develop from Grade 4-12? And how do these 
patterns vary by gender, socioeconomic status, and race/ethnicity? Our analyses are based on 
self-report surveys administered to nearly 400,000 students in the 2014-15 and 2015-16 school 
years. With two years of data, we can only track the development of SEL for a given student 
over the course of a single school year. However, we are able to aggregate information on 
these changes across multiple grade levels in order to simulate long-term trends for students 
expected to remain enrolled in participating districts through middle and high school. More 
specifically, we calculate mean score gains for students who completed the survey in both 
years, and we use these gains to extrapolate from Grade 8 (the midpoint of our sample) to both 
prior and subsequent grades. The results of these simulations show how the SEL constructs 
develop among students who would be expected to attend schools in participating districts 
continuously from Grade 4 through Grade 12, assuming that everything else about those 
districts (including selection into and out of the districts, as well as all aspects of the 
educational environment relevant to SEL development) remain as they were in the 2015-16 
school year. 


In reporting these trends, we emphasize that the measures gathered by the CORE 
districts’ SEL survey are self-reports and therefore reflect students’ subjective assessments of 
their social-emotional skills. Students evaluating their own skills must employ an external frame 
of reference in order to reach a judgment about their relative standing. As a result, differences 
in self-reports over time or across students may reflect differences in normative standards 
rather than authentic differences in skills—a phenomenon known as reference bias (West et al., 
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2016). Students’ responses may also be influenced by social desirability bias (Paulhus, 1991), or 
the tendency of survey respondents to offer positive self-descriptions, and students’ 
susceptibility to this bias also may vary across students and over time. Finally, certain students’ 
responses may also be influenced by cultural differences that lead them to interpret or respond 
to items in different ways, or by differences in their home or school environments that 
influence their ability to demonstrate a given social-emotional skill. We show that students’ 
self-reports of each SEL construct are associated in expected ways with theoretically related 
academic and behavioral indicators, providing at least partial evidence of validity. Even so, we 
urge caution when interpreting changes in these self-report measures over time and 
differences in both levels and trends across subgroups. Although the patterns in students’ self- 
descriptions that we document are of interest in and of themselves, they do not necessarily 
capture true differences in underlying skills. 


These analyses complement and extend a set of recent studies using the CORE districts’ 
SEL survey to provide new insight into the measurement and development of social-emotional 
skills. West, Buckley, Krachman, & Bookman (2018) describe how the four social-emotional 
competencies were selected for assessment, explain the process for curating and piloting 
student surveys, and provide preliminary evidence of the measures’ reliability and validity as an 
indicator of school quality. Meyer, Wang, and Rice (2018) examine the psychometric properties 
of the SEL measures, including consistency of measurement across grades and demographic 
groups. They also use Item Response Theory to develop scale scores for each construct that we 
rely on in this paper. Finally, Loeb et al. (2018) produce and evaluate school-by-grade estimates 
of students’ growth in each SEL construct. The current paper builds upon this body of work by 
providing additional evidence of the reliability and validity of the CORE district SEL measures 
and by conducting the first analyses comparing SEL competencies across grades and subgroups. 
While our findings cannot be generalized beyond the California districts we study and the 
measures they employ, the scope and scale of our data far exceeds anything in the extant 
literature. 


Literature Review 


Despite heightened interest and activity on the part of policymakers, there remains a 
lack of consensus regarding how different aspects of students’ SEL evolve over time. This is in 
part because most investigations of students’ SEL focus on students in early elementary grades 
(Ross & Tolan, 2017). Nevertheless, the literature suggests that, unlike academic achievement, 
children’s and adolescents’ social and emotional development does not proceed linearly or 
monotonically over time (e.g., Pintrich & Zusho, 2002; Schunk & Meece, 2006; Schunk & 
Pajares, 2002; West et al., 2016). Although students are able to engage in more strategic or 
metacognitive thinking as they age (Steinberg, 2007, Wigfield, Byrnes, & Eccles, 2006), 
adolescence is also when students’ social-emotional arousal is at its peak. These patterns 
suggest that specific social-emotional competencies may develop differently depending on the 
degree to which they require emotional regulation relative to cognitive control. 


In this section, we discuss the available evidence on the development of the four 
constructs assessed by the CORE districts’ SEL survey. We then turn to differences in SEL 
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trajectories over time for subgroups defined based on gender, socioeconomic status, and 
race/ethnicity. The four constructs are defined as follows: 


e Self-management, also referred to as self-control or self-regulation, is the ability to 
regulate one’s emotions, thoughts, and behaviors effectively in different situations. This 
includes managing stress, delaying gratification, motivating oneself, and setting and 
working toward personal and academic goals (CASEL, 2005). 


@ Growth mindset is the belief that one’s abilities can grow with effort. Students with a 
growth mindset believe that they can develop their skills through effort, practice, and 
perseverance. These students embrace challenges, see mistakes as opportunities to 
learn, and persist in the face of setbacks (Dweck, 2006). 


e Self-efficacy is the belief in one’s ability to succeed in achieving an outcome or reaching 
a goal. Self-efficacy reflects confidence in the ability to exert control over one’s own 
motivation, behavior, and environment and allows students to become effective 
advocates for themselves (Bandura, 1997). 


e@ Social awareness is the ability to take the perspective of and empathize with others 
from diverse backgrounds and cultures, to understand social and ethical norms for 
behavior, and to recognize family, school, and community resources and supports 
(CASEL, 2005). 


Development of SEL 


Studies generally suggest that self-management (also referred to as self-regulation or 
self-control) declines during early adolescence (Duckworth et al., 2010; West et al., 2016). 
However, studies focusing on how self-management develops throughout adolescence are 
limited (Gestsdottir & Lerner, 2008) and the evidence is mixed.? Some researchers have 
suggested that certain skills required for self-management—such as controlling attention, 
inhibiting responses, and self-monitoring progress—actually increase as students age, but other 
variables related to self-management—such as interest in school, motivation, and the changing 
classroom environment—dampen students’ ability to exercise self-management (e.g., 
Gestsdottir & Lerner, 2008; Pintrich & Zusho, 2002). Therefore, although self-management may 
decline as students age, this likely depends on whether the measures used are also capturing 
related competencies or contextual variables. 


In terms of growth mindset, few studies have examined students’ trajectories over time; 
the literature has focused instead on the relationship of growth mindset and academic 
outcomes (e.g., Blackwell et al., 2007; Claro, Paunesku, & Dweck, 2016) and the effects of 
interventions seeking to foster a growth mindset (e.g., Dweck, 2006; Yeager, et al., 2016). 
Among studies examining changes in growth mindset, the findings are ambiguous. Some 
researchers have reported that growth mindset decreases during middle school (Pintrich & 


3 In contrast, improvements in self-management through infancy and early childhood are well documented (e.g., 
Edossa et al., 2018; Kopp, 1982; Rothbart et al., 2006; Rueda, Posner, & Rothbart, 2005). 
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Zusho, 2002), whereas others show growth mindset may in fact increase during this period 
(West et al., 2016). 


By contrast, a large body of work has established that self-efficacy tends to decline in 
middle school (e.g., Anderman, Maehr, & Midgley, 1999; Pajares & Valiante, 1999; Pintrich & 
Zusho, 2002; Schunk & Meece, 2006; Schunk & Pajares, 2002; Urdan & Midgley, 2003; Wigfield 
et al., 2006). This may be because younger students tend to overestimate their capabilities and 
students’ expectations become more realistic as they age (Pintrich & Zusho, 2002). Increased 
emphasis on competition, social comparison, and norm-referenced grading during the 
transition to middle school may heighten or enhance the accuracy of comparative self- 
assessment (Anderman et al., 1999; Urdan & Midgley, 2003; Wigfield, Byrnes, & Eccles, 2006). 
Indeed, the middle school transition is a particularly vulnerable time for students’ self-efficacy 
beliefs (Schunk & Pajares, 2002; Schunk & Meece, 2006). However, some studies suggest that 
domain-specific self-efficacy (i.e., ELA- or math-specific) increases during middle school (Shell, 
Colvin, & Bruning, 1995; Zimmerman & Martinez-Pons, 1990). This finding suggests that more 
global measures of self-efficacy may manifest different developmental patterns than domain- 
specific measures. 


Finally, research into the development of social awareness indicates that students 
become more socially aware over time as peer groups become more central (Ryan, 2001; 
Rubin, Coplan, Chen, Buskirk, & Wojslawowicz, 2005; Wigfield, Byrnes, & Eccles, 2006). Some 
concepts or skills that are related to or prerequisites of social awareness—such as self- 
awareness, self-reflection, perspective taking, and metacognition—improve as students age 
(Choudhury et al., 2006; Eccles, 1999; Piaget, 1972; Yurgelun-Todd, 2007). However, because 
empirical studies of social awareness generally focus on social skills broadly, it is difficult to 
disentangle particular developmental patterns for social awareness specifically (Farrington et 
al., 2012). In addition, some studies find, contrary to the above results, that younger students 
respond more positively to measures of social skills (Gaspar, Cerquiera, Branquinho, & Gaspar 
de Matos, 2018). 


Development of SEL by Subgroup 


In addition to varying developmental trends for specific SEL constructs, research has 
suggested that the development of these constructs differs across student groups. Here we 
review trends by gender, socioeconomic status, and race/ethnicity. 


Gender. There is good reason to believe that SEL trajectories differ according to 
students’ gender, but the empirical evidence to date has been inconclusive. Early adolescence is 
a time when culturally-relevant gender stereotypes intensify; puberty renders these 
stereotypes more salient and can reshape teens’ perceptions of themselves and others (Eccles, 
1987; Hill & Lynch, 1983; Kagesten et al., 2016). Furthermore, differences between boys’ and 
girls’ biological development can manifest in their non-cognitive skills. For example, girls tend 
to display higher degrees of self-management than boys in elementary school and early 
adolescence (Ablard & Lipshultz, 1998; Duckworth & Seligman, 2006; Moffitt et al., 2011; 
Pintrich & Zusho, 2002; Zimmerman & Martinez-Pons, 1990). 
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Evidence of gender differences in self-efficacy is more ambiguous. Some studies suggest 
that boys and girls have similar self-efficacy in elementary school, but girls display lower self- 
efficacy during the transition to middle school (e.g., Anderman, et al., 1989; Wigfield, Eccles, 
Maclver, Reuman, & Midgley, 1991; Wigfield, Eccles, & Pintrich, 1996). Yet, other studies 
suggest that gender differences during this time interact with students’ level of academic 
achievement and stereotypic gender beliefs (Eccles, Adler, & Meece, 1984; Schunk & Pajares, 
2002). As a result, gender differences in self-efficacy may be domain-specific, with girls tending 
to show higher levels than boys of self-efficacy in ELA but lower levels in math (Eccles, Wigfield, 
& Schiefele, 1998; Jacobs, Lanza, Osgood, Eccles, & Wigfield, 2002; Marsh, 1989; Schunk & 
Meece, 2006; Wigfield et al., 1991). In contrast, some studies find no evidence of gender 
differences in self-efficacy (e.g., Pajares, 1996; Pajares & Graham, 1999; Roeser, Midgley, & 
Urdan, 1996; Smith, Sinclair, & Chapman, 2002). 


In terms of growth mindset, girls are generally viewed as being more likely than boys to 
endorse a fixed mindset, rather than a growth mindset (Dweck, 1986, 2000; Dweck & Simmons, 
2014; Halvorson, 2011), particularly when asked about their abilities in stereotypically male 
domains such as math or science (i.e., male-stereotyped domains; Farrington et al., 2012). 
However, multiple studies have found no relationship between gender and growth mindset 
(e.g., Macnamara & Rupani, 2017; Storek & Furnham, 2013; Tucker-Drob, Briley, Engelhardt, 
Mann, & Harden, 2016). 


Finally, research suggests that girls display higher social awareness than boys during the 
transition to middle and high school. Because boys and girls experience distinct socialization 
practices during adolescence (Kagesten et al., 2016), girls’ relationships to peers and families 
might differentially affect how they develop self- and social awareness. Specifically, Wentzel 
(1994) found that girls tend to display higher degrees of social behavior, social acceptance, 
social goal pursuit, and perceived social support. Gaspar and colleagues (2018) showed that 
although boys respond more positively to measures of subjective well-being, social support, 
problem solving, and emotional regulation, girls responded more positively to measures of 
basic social skills and interpersonal relationships. Similarly, studies have indicated that girls tend 
to suffer from intrapersonal behavior challenges, whereas boys tend to suffer from 
interpersonal behavior challenges (Hatzchristou & Hopf, 1996; Underwood, 2004). This 
discrepancy can be further exacerbated by teachers’ differential expectations of boys’ and girls’ 
social behavior (Sonja, Milena, Jana, & Cirila, 2009). 


Socioeconomic status. Relatively few studies examine how students’ socioeconomic 
status (SES) is associated with social-emotional competencies (Schunk & Meece, 2006), but the 
bulk of the available evidence suggests the existence of gaps in SEL favoring economically 
advantaged students. For example, evidence suggests that students from economically 
disadvantaged backgrounds lag behind their peers in skills related to self-management, such as 
emotional regulation (Papini, Farmer, Clark, Micka, & Barnett, 1990), adaptability (Davis, 2012), 
or impulsive behavior (Takeuchi, Williams, & Adair, 1991). Factors related to self-efficacy have 
also been shown to vary by SES. For example, economically disadvantaged students may have 
lower self-esteem (Bolger, Patterson, Thompson, & Kupersmidt, 1995), they may be more likely 
to experience learning challenges early in school that dampen their self-efficacy later on 
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(Schunk & Miller, 2002), and their parents may have reduced expectations of their academic 
success (Alexander & Entwisle, 1998). In terms of growth mindset, a recent study found that 
students in Grades 4-12 attending schools with a higher concentration of students in poverty 
reported lower levels of growth mindset (Snipes & Tran, 2017). Finally, research shows that 
students from economically disadvantaged backgrounds may lag in competencies related to 
social awareness, as they may be more likely to struggle with peer relationships (Bolger, et al., 
1995) or social competence (Winer & Thompson, 2013). 


More generally, a large body of evidence shows that growing up in poverty is a major 
risk factor for low levels of social and emotional well-being in adolescence and adulthood 
(Bradley & Corwyn, 2002; Brooks-Gunn & Duncan, 1997; Kupersmidt, Griesler, DeRosier, & 
Patterson, 1995; Takeuchi et al., 1991; Yoshikawa, Aber, & Beardslee, 2012). However, much of 
this research focuses on behavioral indicators, such as aggression (e.g., Colder, Mott, Levy, & 
Flay, 2000; Sinclair, Pettit, Harrist, Dodge, & Bates, 1994) or misconduct (e.g., McCoy, Frick, 
Loney, & Ellis, 1999); on psychological well-being and mental illness (e.g., McLeod & Shanahan, 
1993; Ortega & Corzine, 1990); or on physical well-being, such as health (e.g., Starfield, 1989) or 
substance abuse (e.g., Wills, McNamara, & Vaccaro, 1995). Evidence on the role of SES also may 
be sensitive to the measurement of SEL. Many studies showing a link between SES and SEL rely 
on parent or teacher reports of student behaviors (e.g., Duncan, Brooks-Gunn, & Klebanov, 
1994, McLeod & Shanahan 1993; McLoyd, 1998), whereas one study of adolescent se/f-reports 
did not find a relationship between poverty and SEL (Conger, Conger, & Elder, 1997). 


Race/ethnicity. Most of the literature examining racial and ethnic subgroup differences 
in SEL consist of cross-sectional studies measuring SEL at a single time point. Few studies have 
examined racial or ethnic differences in how adolescents develop self-regulation skills related 
to self-management (Pintrich & Zusho, 2002). For self-efficacy, there are mixed results. Some 
studies show no difference across different racial/ethnic groups (e.g., Britner & Pajares, 2001; 
Roeser et al. 1996). Other studies find that Asian students report lower self-efficacy (Eaton & 
Dembo, 1997), that Latinx teens report lower self-efficacy in writing (Pajares & Johnson, 1996), 
and that African American teens report lower self-efficacy in math (Pajares & Kranzler, 1995); 
still other studies suggest that certain underrepresented minority students may report higher 
degrees of their sense of academic competence (e.g., Graham, 1994). Few studies explicitly 
examine differences in growth mindset among adolescents of differing racial or ethnic 
background. One recent report found that African American and Latinx students self-reported 
lower levels of growth mindset than their White counterparts, but this finding was based on 
evidence from a single school district (Snipes & Tran, 2017). Finally, evidence of students’ social 
awareness based on race or ethnicity is limited to elementary and middle school, and findings 
are ambiguous. DiPerna and Elliott (1999) describe how minority elementary school students 
were rated lower than their White counterparts on teacher-reported measures of interpersonal 
skills, but Malecki and Elliott (2002) report no differences in teachers’ reports of social skills for 
White and minority students. Additionally, Wentzel (1994) showed that White middle schoolers 
were rated as more socially adept by their peers and teachers than African American students. 
So far, students’ self-reported levels of social awareness have not been examined. 
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Summary 


Taken together, an extensive body of research examining students’ social and emotional 
skills at different points in time suggests that the development of students’ social and 
emotional learning is construct-specific and may vary across different groups of students. 
Overall, the literature suggests self-management and self-efficacy may decrease in adolescence, 
while social awareness is expected to increase. Meanwhile, conflicting results regarding specific 
social skills highlight the need for more research examining trends in social awareness, and it is 
unclear whether growth mindset is expected to increase or decrease during elementary, 
middle, and high school. In terms of gender differences, research implies that girls are expected 
to have superior self-management and social awareness skills relative to boys, whereas girls are 
thought to have more of a fixed mindset and lower self-efficacy than boys—particularly with 
regard to male-stereotyped domains such as math and science. For differences by 
socioeconomic status, research indicates that students from economically disadvantaged 
backgrounds have lower SEL competencies relative to their more advantaged peers. However, 
since only a small proportion of the existing research focuses on SES differences, there is 
additional need for evidence supporting this hypothesis. As for racial and ethnic differences, 
there is little consensus as to whether minority students have higher or lower self- 
management, social awareness, or self-efficacy, and research surrounding minority students’ 
growth mindset has mostly focused on the effectiveness of interventions related to growth 
mindset for improving minority students’ academic achievement. It is possible that these 
conflicting findings stem from potential confounding with socioeconomic status, as well as with 
the specificity versus generality of the measures used to assess self-efficacy. The current study 
aims to shed additional light on to how these aspects of SEL develop over time as students 
progress through school. 


Data and Methods 


The CORE districts’ SEL survey comprises a battery of items designed to measure four 
SEL constructs: self-management (9 items), social awareness (8 items), growth mindset (4 
items), and self-efficacy (4 items). Students in Grades 4-12 rate themselves on the same 25 
questions using a 5-point Likert scale. The same set of 25 questions was used in the 2014-15 
and 2015-16 school years. 


Measuring SEL development using these data requires us to transform the responses to 
the SEL items on the student survey into a metric. We create scale scores for each of the four 
SEL constructs for students who responded to at least half of the survey items associated with 
that construct. Following Meyer, Wang, & Rice (2018), we use a generalized partial credit model 
(GPCM) to convert students’ responses to these items into a scale score for each of the four 
constructs. Based on Muraki’s (1992) extension of the partial credit model (PCM; Masters, 
1982), GPCM can incorporate measures for which responses are on a multipoint scale, rather 
than only dichotomous items. The GPCM assigns more weight to items that better distinguish 
among students with different construct-specific abilities and appropriately accounts for 
missing student survey responses. Using a PCM in place of a GPCM to produce SEL scale scores 
yielded very similar substantive results, however, as did using raw scores. 
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Analytic Sample 


Six CORE districts participated in the SEL survey in the 2014-15 and 2015-16 school 
years. These districts collectively serve roughly 572,000 students in Grades 4-12 across 1,200 
schools. Approximately 390,000 (about 70%) of students in the districts completed the survey 
each year. Our analysis of the reliability and validity of the SEL measures is based primarily on 
the 2015-16 survey administration, though we also use data from the 2014-15 survey to 
examine the across-year reliability of the measures for students surveyed in both years. Our 
analysis of trends in the development of SEL across grades is also based on students surveyed in 
both years in order to address the possibility of non-random entry into and exit from schools 
within the CORE districts across grade levels. 


As in any survey, not all students completed all items on the SEL survey. On average, 
each item was answered by 97.1% of the students across all grades in 2014-15 and by 97.5% of 
the students across all grades in 2015-16. Although the response rate on individual items was 
high, fewer than 70% of students completed all 25 survey items. Our final analytic sample 
included students who completed at least 50% of the items within each SEL construct. For 
example, the self-management construct has nine items in total. While analyzing self- 
management, we limited our sample to students who answered five or more self-management 
items. If a student answered five self-management items but skipped all growth mindset items, 
this student was included in analyses related to self-management but was excluded in analyses 
related to growth mindset. This analytic sample excluded only 0.47% of students from the full 
survey sample on average (across grades and constructs) in 2014-15 and 0.38% of students on 
average in 2015-16. Scale scores from the GPCM were used for all analyses to account for the 
remaining missing items. 


Table 1 provides descriptive statistics for the analytic sample for the self-management 
construct in the 2015-16 school year (Panel A), as well as for all students enrolled in Grades 4- 
12 in the districts administering the survey that year (Panel B). Although the precise analytic 
sample varies across constructs because the inclusion criteria are applied separately to each 
construct, differences in the demographic composition of these samples are trivial. Students 
attending schools in the CORE districts in these grades are predominately Latinx (69 percent) 
and economically disadvantaged (73 percent); 36 percent are classified as English language 
learners. Sixty-eight percent of CORE students (389,211) were surveyed and responded to at 
least half of the nine items used to measure self-management. Relative to the full sample, 
students in the self-management analytic sample were roughly 3 percentage points more likely 
to be economically disadvantaged, 2 percentage points less likely to be African American, and 1 
percentage point more likely to be Latinx, female, and not to have a disability. All other 
differences in demographic characteristics were smaller than a full percentage point. These 
patterns are generally consistent across grade levels. 
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Table 1. Descriptive Statistics for 2015-16 Sample 


Panel A: Self-Management Analytic Sample 


Grade Grade Grade Grade Grade Grade Grade Grade Grade Total 
4 5 6 7 8 9 10 11 12 


50.9% | 50.4% | 50.4% | 50.9% |50.5% |50.8% | 51.0% 49.7% | 49.7% | 50.5% 
ia - 


African 
American 7.8% 7.7% 7.8% 7.7% 7.8% 8.1% 8.2% 8.4% 8.0% 7.9% 


70.3% | 69.1% | 68.3% | 69.3% | 71.1% | 70.4% 69.2% | 68.7% | 69.8% 
51.1% | 42.6% | 34.8% | 32.0% | 27.7% | 24.6% 19.8% | 18.8% | 35.5% 


ll lll dal ls 
i ld 
a lad la lal 
Glial ll 


(students) | 56,141 | 55,488 | 44,138 | 42,995 | 43,039 | 40,820 | 39,824 | 34,516 | 32,250 | 389,211 


N 


(schools) 724 840 388 232 275 273 232 1,114 
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Panel B: All Students Enrolled in CORE Districts 


Sooeoesooo 


Laue 51. ae 51. la 51. = 51.4% |51.4% |52.1% | 52. lad 50. laa 51. eas 51. laa 


African 
68.2% 68.0% 68.0% 67.8% 68.5% 70.2% 70.0% 68.5% 68.2% 68.6% 
48.8% 50.1% | 43.5% 36.2% 33.2% 30.9% 26.7% 22.2% 22.4% 35.5% 


aal 2. pall 3. laa 3. lial 3. laa 2. aa 2. fal 3. lca 


72,213 | 69,326 | 62,495 | 61,170 | 60,984 | 67,716 | 64,622 | 56,071 | 58,375 | 572,972 
“ “ 


Methods for Assessing Reliability and Validity 


Prior to examining trends in SEL, we first employ several approaches to assess the 
reliability and validity of the measures gathered via the CORE districts SEL survey. For reliability, 
we examine the distributions of the SEL scale scores; we assess internal consistency using 
Cronbach’s coefficient alpha, including alpha normalized to the number of items in the longest 
scale (i.e., self-management, with nine items) using the Soearman-Brown formula (Brown, 
1910; Spearman, 1910); and we compute across-year correlations for each construct to 
examine temporal stability. For validity, we examine inter-correlations among the four SEL 
measures by grade and each measure’s relationships with theoretically related academic and 
behavioral indicators. Specifically, we compute correlations between each SEL measure and 
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math and English language arts test scores and compare the mean number of days absent and 
days suspended for students within the bottom, middle, and top tercile of each SEL measure 
within their grade level. 


Method for Simulating Trends 


Because the data at hand are cross-sectional, we cannot interpret the means of each 
SEL construct by grade as observed in either the 2014-15 or 2015-16 school years as depicting 
true trends in students’ SEL over time for two reasons. First, there could be idiosyncratic 
differences in SEL across grade cohorts. Second, there could be (and likely is) non-random entry 
into or exit out of the CORE districts across grade levels that is related to SEL. That is, students 
with particularly high or low levels of SEL may be systematically more likely to enter or exit the 
districts at specific grade levels. The method described below exploits the availability of 
repeated cross-sections from two consecutive years to address these issues. 


In brief, we take the year-to-year changes in each construct for students who complete 
the survey for two consecutive years, and we anchor those changes to a specific mean (for 
Grade 8, which is the midpoint of our data) to produce “simulated cohort trends” and their 
associated standard errors. These simulated cohort trends can be interpreted as showing 
trends in the SEL constructs among students who would be expected to attend CORE district 
schools continuously from Grade 4 through Grade 12, assuming that everything else about the 
CORE districts (including selection into and out of the districts, as well as all aspects of the 
educational environment relevant to SEL development) remain as they were in 2014-15 and 
2015-16. In other words, they represent a steady-state approximation of trends over time. This 
estimation method can equivalently be viewed as a model of student-level data that includes 
year effects and student-level effects. 


For all analyses, we use a version of the GPCM true scores that have been standardized 
so that the mean score across grades within a construct is 0 and the standard deviation of the 
scores across grades within a construct is 1. The SEL scores were rescaled to this standardized 
scale to simplify presentation of the results, but the rescaling has no effect on the 
interpretation of the results. 


To implement this approach, we first calculate the mean gain of SEL scores, 6% g¢m), for 
students who are enrolled in both years, which we refer to as the “matched sample” (i.e., 2015- 
16 standardized true score minus 2014-15 standardized true score) in each gradegin 2015-16 
and subgroupm. For example, for students in Grade 9 in 2015-16, the gain is calculated by 
subtracting Grade 8 scores in 2014-15 from Grade 9 scores of the same students in 2015-16. 


To obtain the simulated mean score in a given grade,om), the mean gains (positive or 
negative) are added to the full sample mean score in a base grade,’ gm). We choose Grade 8 
as the base grade for the results presented in this paper, but this has no effect on the shape of 
the trend data; the choice of the base grade simply anchors the trend data around an actual 
cohort of students. Thus, the simulated score for each subgroup in grades after Grade 8 is as 
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follows (note that the summation of the delta term begins at 9, because it is the term for the 8- 
9 transition): 


* h= 
Hee =U eG nes «Oca 


For grades earlier than 8 (i.e., Grade 7 and below), the following formula estimates the 
simulated score for each grade and subgroup (note that the summation of the delta term 
continues through Grade 8, because that term is for the 7-8 transition): 


Ugcm) = BE’ acm) — ie, Onan 


For example, for the simulated score in Grade 11, the gains of Grade 9, 10, and 11 are added to 
mean score in Grade 8. For the mean score in Grade 6, the gains of Grade 8 and 7 are 
subtracted from the mean score in Grade 8. 


The error variances of U%g¢myand 6” gm) are given by the standard formulas for the 
variance of a mean. The error variance of the simulated score is equal to the sum of the error 
variances of the components. We assume that the covariance between the values of 6“ qm) is O 
since the means are based on different samples of students. The following formula shows this 
computation when simulating from Grade 8 to subsequent grades. The square root of this term 
produces the standard error. 


h=g 


opm) = VG em) = VGN sem) + >, VO gemy) 
h=9 


For grades earlier than Grade 8, the equivalent variance is calculated as follows: 
5c) = V (Ugo) =V Cea) + Diag VCO gcny)- 


This method of simulating trends in SEL across grades requires us to focus on the subset 
of students who participated (and completed a majority of the items measuring a given 
construct) in both the 2014-15 and 2015-16 survey administrations. Appendix Table A1 
provides descriptive statistics for this matched sample for the case of the self-management 
construct. The demographic characteristics of the students in this matched sample again 
correspond closely to those of the analytic sample for 2015-16 and of all students enrolled in 
CORE districts. 


Results 


We begin the presentation of our results by providing evidence on the reliability and the 
validity of the CORE districts’ SEL measures. We then describe the results of the simulated trend 
analysis. 
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Evidence of Reliability 


We first examine the distributions of student scale scores for each SEL construct. We 
find that the distributions of the SEL scale scores exhibit evidence of ceiling effects, with a 
substantial proportion of students choosing the most positive response to every item within a 
construct. Figure 1 illustrates this pattern by presenting histograms of the SEL scale scores in 
Grade 4 and Grade 12; histograms for other grades are similar. A ceiling effect is evident for all 
four constructs, but it is especially pronounced for the scale measuring growth mindset. These 
ceiling effects will present a challenge for efforts to analyze changes in SEL over time for 
individual students within the CORE districts. At the same time, they do not necessarily limit our 
ability to document trends across the full sample of surveyed students or numerically sizable 
subgroups. Each measure exhibits ample variation at both grade levels and, apart from the 
existence of ceiling effects, a roughly normal distribution. 


Figure 1. Histogram of Distribution of SEL Scale Scores, Grades 4 and 12 
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We next assess the internal consistency of student self-reports by examining the inter- 
item correlation of the survey scales. Figure 2 depicts Cronbach’s alpha for each scale, as well as 
alpha when normalized to nine items (i.e., the number of items in the self-management 
construct); because internal consistency decreases mechanically with the number of items, the 
normalized measure is more comparable across survey scales of varying length. We find that 
the measures generally demonstrate a high degree of internal consistency across all grade 
levels. The lone exception is the scale used to measure growth mindset, for which Cronbach’s 
alpha drops below the commonly accepted benchmark of 0.7, particularly for younger students 


(e.g., fourth and fifth graders). 
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Figure 2. Internal Consistency of Social-Emotional Measures 
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In addition to internal consistency as measured by Cronbach’s alpha, another important 
aspect of reliability is temporal stability. In an effort to minimize disruption to instructional 
time, CORE elected not to administer its SEL measures to the same students multiple times the 
same year in a manner that would make it possible to calculate two-week test-retest 
reliabilities. We can, however, provide evidence on the measures’ temporal stability over one 
year among students who participated in both the 2014-15 and 2015-2016 surveys (Figure 3). 
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Figure 3. Across-Year Correlation of Social-Emotional and Test-Score Measures, 2014-15 and 
2015-16 
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Figure 3 reports Pearson correlation coefficients for each SEL measure and, for purposes 
of comparison, state test scores through Grade 8. Noise-corrected correlations, which use our 
estimates of the measures’ internal consistency to adjust for measurement error, are also 
displayed. As expected, students’ math and English language arts (ELA) test scores are highly 
correlated from one year to the next (r = 0.82 - 0.87, p < .001), and the strength of this 
relationship is similar across grade levels. Although also statistically significant (jp < .001), the 
parallel reliability estimates for the SEL measures are markedly lower (r = 0.22 - 0.53) and, with 
the exception of self-management, tend to increase across grades. The figure also confirms that 
the lower internal consistency of the SEL survey scales accounts for only a small fraction of the 
differences in stability between the SEL measures and test scores. Although striking, the lower 
temporal stability observed for the SEL measures is not necessarily a concern, given that one 
reason for educators’ interest in SEL is the notion that they may be more malleable over time 
than cognitive ability. 


Evidence of Validity 


The four SEL measures are positively correlated with one another, though the strength 
of these relationships varies across constructs. Figure 4 plots these inter-correlations by 
construct and grade level. The correlations are consistently lowest for growth mindset. 
Meanwhile, the strongest relationships are observed for self-management and social 
awareness, with correlation coefficients between 0.5 and 0.6 depending on the grade level. 


Each of the SEL measures is also related to the limited set of academic and behavioral 
indicators available in each district’s administrative data: test scores, absences, and 
suspensions. Figure 5 plots the correlations between (i) each SEL measure and (ii) test scores in 
ELA and math in Grades 4-8 and 11—i.e., the grades in which California administers its state 
test (the Smarter Balanced Assessment Consortium). Two clear patterns are evident. First, the 
four SEL measures differ in the strength of their correlation with academic achievement as 
measured by state tests. The strongest relationships are generally observed for growth mindset 
and self-management, with correlations ranging between 0.3 and 0.4 between Grades 4 and 8. 
Interestingly, despite the fact that self-management and social awareness are strongly 
correlated with one another, they differ markedly in their relationship to test scores, with the 
correlations for social awareness hovering around 0.2 between Grades 4 and 8. Second, the 
relationship between each SEL construct and test scores in both subjects falls sharply between 
Grade 8 and 11. 


The SEL measures are also predictive of student absences and suspensions. Students 
who assign themselves lower ratings on each construct miss more days and experience more 
out-of-school suspensions. Figure 6a plots the mean number of days absent for students in the 
bottom, middle, and top third within their grade level on each SEL measure; Figure 6b presents 
analogous information for the number of suspensions. We compare terciles of students when 
examining these outcomes because their non-normal distribution, with many students 
experiencing relatively few days absent and suspensions, renders correlation coefficients less 
informative. Other means of dividing students into groups (e.g., quartiles) yield comparable 
results. 
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Figure 4. Within-Year Correlations Among Social-Emotional Measures, 2015-16 
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Figure 5. Within-Year Correlations Between Social-Emotional Measures and Test Scores, 2015- 
16 


ELA Math 

0.4 
c Construct 
2 oe -* Growth Mindset 
s -* Self Efficacy 
Oo -* Self Management 
Oo ~* Social Awareness 

0.2 

4 5 6 7 8 11 4 5 6 7 8 11 
Grade 


@ Trends in Student Social-Emotional Learning: Evidence from the CORE Districts 


Policy Analysis for California Education 
—xOS————————————————————————————— ae 


Figure 6. Mean Number of Days Absent and Suspensions by Social-Emotional Tercile, 2015-16 


Panel a: Mean Number of Days Absent 
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Figure 6a reveals that, at each grade level, students in the bottom third of each SEL 
measure are absent considerably more days, on average, than students in the top third; these 
gaps tend to expand between Grades 4 and 9, perhaps because students come to exercise 
greater autonomy in their absence behavior, before narrowing in the final years of high school. 
The gaps are largest for self-management, where a ninth-grade student in the bottom third is 
expected to be absent 2.9 additional days, or 56 percent more frequently, than a ninth-grade 
student in the top third. Similarly large gaps across the three groups are evident for self- 
efficacy, whereas gaps for social awareness and growth mindset are modestly smaller. 
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Panel b: Mean Number of Suspensions 


Growth Mindset Self-Efficacy 

0.15 | 

0.10 

0.05 
7) 
¢ 
2 
2 Survey Tercile 
5 0.00 
Qa -* High 
2 Self-Management Social Awareness -e Middle 
WM 0.15 | 
c -* Low 
oO 
® 
= 

0.10 

0.05 

0.00 


04 05 06 07 08 09 10 11 12 04 05 06 O07 08 09 10 11 12 
Grade 


Figure 6b displays the parallel analysis for the number of suspensions, which peak in 
frequency in the CORE districts in Grades 7 and 8. We again see clear relationships for each SEL 
measure: Students who rate themselves critically are suspended more often. This relationship is 
most pronounced for self-management, where students in the bottom third experience 0.15 
suspensions on average, more than seven times as many as students in the top third. 
Suspensions are much less frequent overall, and the gaps between students reporting different 
levels of SEL, in Grades 4-5 and Grades 11-12. 


Trends in SEL Measures Across Grades 


We now turn to the main results of this paper: simulated cohort trends of each SEL 
construct across grades for all students and various subgroups. In Figure 7, we first present the 
cross-sectional (i.e., non-simulated) mean scale scores for each SEL measure separately by 
grade level for Grades 4-12; ELA and math test scores are included for comparison purposes. It 
is immediately evident that, unlike the academic knowledge and skills captured by state test 
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scores, students’ SEL does not increase monotonically across grades. Rather, average scores for 
three of the SEL constructs (growth mindset is the partial exception) decline markedly from 
Grade 6 to Grade 9 before appearing to recover partially or entirely in high school. In some 
cases, the differences in average scores across grade levels are substantial in magnitude. For 
example, the level of social awareness reported by students in Grade 4 is more than 0.5 
standard deviations greater than that reported by students in Grade 9. A parallel figure based 
on cross-sectional data from the 2014-15 school year (not shown) shows nearly identical 
patterns, suggesting that the patterns evident in Figure 7 reflect consistent differences across 


grade levels rather than idiosyncratic differences across the cohorts of students enrolled in a 
grade in a given year. 
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Figure 7. Mean Social-Emotional Construct Score and Test Score by Grade, 2015-16 
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We next use the method described above to simulate the developmental trajectory of 
each SEL construct between Grades 4 and 12. Figure 8 plots these simulated trends for each 
construct alongside the same grade-level means reported in Figure 7. Because the simulations 
are anchored at the full-sample mean for Grade 8, the two lines overlap at that point by 
construction. In addition to simulated means, the figure also displays 95 percent confidence 
intervals around each simulated data point. These confidence intervals become larger as one 
moves away from Grade 8 in either direction, due to the compounding of measurement error 
from combining estimates of gain scores across multiple grade levels. Although the full-sample 
means are also measured with uncertainty, their confidence intervals are trivially small due to 
the large number of surveyed students and are excluded to enhance the figure’s legibility. 
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Figure 8. Mean Social-Emotional Construct Score: Full Sample vs. Simulated Trend Based on 
2015-16 Changes 
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The simulated trends presented in Figure 8 confirm what the cross-sectional means 
suggested: the social-emotional skills measured by the CORE districts do not increase 
monotonically as students advance through school. Growth mindset is a partial exception, with 
students who remain enrolled in CORE districts from Grade 4 to Grade 12 registering fairly 
steady growth of approximately 0.06 standard deviations annually between Grade 4 and Grade 
10, before leveling off through the remainder of high school. Conversely, students’ scores on 
self-efficacy and social awareness decline by 0.38 and 0.56 standard deviations, respectively, 
between Grade 4 and Grade 12, with the most rapid declines occurring while students are 
enrolled in the middle-school grades. In the case of self-management, student scores increase 
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by roughly 0.2 standard deviations between Grade 4 and Grade 6, decline by a similar amount 
by Grade 8, and remain roughly stable thereafter. 


The differences between the simulated and cross-section trends evident in Figure 8 
reflect the influence of non-random entry into or exit from the districts participating in the SEL 
survey across grade levels. For example, the simulation shows students making substantial 
gains in growth mindset between Grade 4 and Grade 9 that were not clearly evident in the 
cross-sectional analysis. Substantively, this implies that students reporting higher levels of 
growth mindset are more likely to exit participating districts prior to Grade 9 (or that students 
entering in those years tend to report lower levels). It could be the case that students with 
more of a growth mindset—those who believe that their intelligence can be improved with 
effort—are more likely to seek out alternatives to traditional public schools during the late 
elementary and middle school years. As a result, the increases in growth mindset made by 
students remaining enrolled in CORE district schools evident in the simulated trend do not 
translate into higher levels of growth mindset across grade levels when examined in a cross- 
section. 


Even more striking are the gaps between the simulated trends and cross-sectional 
means at the end of high school, as only the latter shows evidence of improvements in each 
construct after Grade 10. In this case, the cross-sectional differences across grade levels appear 
to be a consequence of students who score lower on each SEL construct being more likely to 
leave CORE district high schools prior to Grade 12. 


Subgroup Results 


Figures 9, 10, and 11 present trends separately by student gender, economic 
disadvantage, and race/ethnicity, respectively. The SEL scores of female and male students 
attending CORE district schools differ notably in terms of both levels and trends. As shown in 
Figure 9, girls exhibit a sizable advantage over boys with respect to both self-management and 
social awareness that is present across all grade levels but becomes smaller as students age. In 
the case of self-management, girls score 0.4 standard deviations higher than boys in Grade 4 
and 0.2 standard deviations higher in Grade 12; the bulk of the narrowing of the gender gap for 
self-management occurs between Grade 6 and Grade 8, when girls experience a larger decline 
in this construct. In the case of social awareness, girls’ advantage starts at 0.32 standard 
deviations in Grade 4 and narrows to 0.15 standard deviations by Grade 12. 


Trends for girls and boys differ even more dramatically for self-efficacy. For this 
construct, girls start out with a modest 0.12 standard deviation over boys in Grade 4. However, 
girls experience a decline in self-efficacy that is particularly steep between Grade 6 and Grade 
8, when girls’ self-efficacy scores decline by 0.11 standard deviations by Grade 6 and by an 
additional 0.46 standard deviations by Grade 11, before recovering modestly in Grade 12. Boys 
also register a decline in self-efficacy between Grades 6 and 11, but the slope in their scores is 
far more gradual. As a result of these trends, girls’ self-efficacy starts to lag that of boys in 
Grade 6 and is roughly one-third of a standard deviation lower throughout high school. 
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In contrast with the other three constructs, trends with respect to growth mindset are 
quite similar across genders. Girls exhibit a small advantage over boys in elementary school that 
narrows (and becomes statistically insignificant) in middle school, but reemerges slightly in high 
school. 


Figure 9. Simulated Trends in Mean Social-Emotional Construct Score by Gender, 2015-16 
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Figure 10 reveals that students who are not economically disadvantaged exhibit higher 
levels of each SEL construct across all grade levels than those who are. These gaps at Grade 4 
range in magnitude from 0.2 standard deviations for social awareness to 0.35 standard 
deviations for self-management. The gaps widen somewhat in the middle-school grades before 
narrowing again in high school. In the case of self-management, the result is a narrowing of the 
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self-management gap associated with economic disadvantage from 0.35 standard deviations in 
Grade 4 to 0.14 standard deviations in Grade 12. Gaps in growth mindset and self-efficacy also 
narrow over this eight-year period, but by a smaller amount. 


Figure 10. Simulated Trends in Mean Social-Emotional Construct Score by Economic 
Disadvantage, 2015-16 
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Finally, Figure 11 documents differences in both levels and trends in SEL for students of 


different racial and ethnic backgrounds. Consistently across grade levels, White students report 
higher levels of each SEL construct than do other student groups, though the levels of self- 
management reported by Asian students follow closely behind those of White students and 
often do not differ by a statistically significant amount. African American and Latinx students— 
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the latter comprising the bulk of students enrolled in the CORE districts—generally report lower 
levels of self-management and social awareness than do White and Asian students. In the case 
of self-management, these gaps narrow from 0.48 and 0.51 standard deviations in Grade 4 for 
African American and Latinx students, respectively, to 0.25 and 0.35 standard deviations by 
Grade 12. However, in the case of social awareness, the size of the gap between African 
American and Latinx students and White students widens modestly over the same period. 


Figure 11. Simulated Trends in Mean Social-Emotional Construct Score by Race/Ethnicity, 2015- 
16 
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The patterns observed across racial groups for growth mindset and self-efficacy are 
more complex. In Grade 4, White students’ growth mindset scores exceed those of each of the 
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other groups by roughly 0.4 standard deviations. Although growth mindset increases for 
students of all races by Grade 12, these initial gaps favoring White students narrow by more 
than half. The timing of the largest increases in growth mindset is delayed for Latinx students, 
however, with the bulk of the gains occurring between Grade 7 and Grade 9, rather than in 
elementary school. As a result, Latinx students report noticeably lower levels of growth mindset 
than all other groups throughout the upper elementary and middle-school grades. In the case 
of self-efficacy, White, African American, and Latinx students follow similar trends from Grade 4 
to Grade 12, with the scores of White students exceeding those of African American and Latinx 
students by roughly 0.2 and 0.3 standard deviations, respectively. Trends for Asian students are 
quite different, however. Their self-reported self-efficacy increases through Grade 6 and 
remains very close to that of White students through Grade 8. However, Asian students’ self- 
efficacy drops by more than one-third of a standard deviation between Grade 8 and Grade 11, 
leading them to emerge as the lowest-scoring group on this construct by the end of high school. 


Discussion 


This paper uses self-reported measures from nearly 400,000 students in Grades 4-12 
across six school districts to simulate trends over time in four specific social-emotional 
competencies: Self-management, self-efficacy, growth mindset, and social awareness. In the 
following, we discuss our findings with respect to our main research questions: (i) How do four 
key SEL constructs (growth mindset, self-efficacy, self-management, and social awareness) 
develop from Grade 4-12? And (ii) how do these patterns vary by gender, socioeconomic status, 
and race/ethnicity? 


Trends in SEL 


The simulated cohort trends first reveal that, at least within our sample districts, cross- 
sectional differences in mean SEL scores across grade levels are skewed by non-random entry 
and exit of students and therefore do not provide an accurate picture of average growth in SEL 
skills over time. For example, the simulated trends shows students making larger gains with 
respect to growth mindset in elementary and middle school than would be implied by a naive 
interpretation of the cross-sectional data. Conversely, the cross-sectional data misleadingly 
suggest that students make strong gains with respect to each construct in high school, whereas 
the simulated cohort trends reveal that this pattern it driven at least in part by differential 
dropout behavior. That is, students with lower levels of these social-emotional competencies 
are more likely to leave high schools in participating districts between Grades 9 and 12. These 
differences between the cross-sectional data and simulated trends suggest that the CORE 
districts’ survey-based measures of SEL are valid predictors of continued enrollment in 
participating districts. They also highlight the importance of the method we employ to examine 
SEL development. 


Our findings substantiate claims that the development of students’ does not proceed 
linearly or even monotonically over time (e.g., Pintrich & Zusho, 2002; Schunk & Meece, 2006; 
Schunk & Pajares, 2002). For self-management, we find that this construct improves in the late- 
elementary grades but then decreases during middle school before tapering off in high school. 
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This aligns with findings from other researchers (e.g., Duckworth et al., 2010; Edossa et al., 
2018; Kopp, 1982; Rothbart et al., 2006; Rueda, Posner, & Rothbart, 2005; West et al., 2016), 
but unlike these studies, we examine self-management trends across both childhood and 
adolescence in a single dataset. Self-efficacy also appears to decline in middle school in line 
with previous studies (e.g., Anderman et al., 1999; Pajares & Valiante, 1999; Pintrich & Zusho, 
2002; Schunk & Meece, 2006; Schunk & Pajares, 2002; Urdan & Midgley, 2003; Wigfield et al., 
2006). As an exception, students’ growth mindset seems to increase with age during early 
adolescence, consistent with the findings of West and colleagues (2016) for three schools, with 
these gains tapering off while students are in high school. 


Notably, however, the results of our simulated cohort trends differ from most existing 
research on social skills (e.g., Choudhury, et al., 2006; Eccles, 1999; Piaget, 1972; Rubin, et al., 
2005; Ryan, 2001; Wigfield et al., 2006; Yurgelun-Todd, 2007). We find that social awareness in 
fact declines across grades, with a particularly notable plunge between Grades 6 and 9. This 
discrepancy is potentially due to the particular focus of the CORE districts’ measure of social 
awareness. The CORE items’ ask students to quantify how often they engaged in behaviors 
taking others’ thoughts and feelings into account, articulating their own feelings, and getting 
along with others who are different from them, while other studies measure if peer groups 
become more central to students’ identities and experiences as they age (Rubin, et al., 2005; 
Ryan, 2001; Wigfield et al., 2006). In addition, third-party observations of students’ perspective 
taking or social skills might increase as students age, even if their self-perceptions of these 
behaviors or skills may not. 


Trends in SEL by Subgroup 


Gender. Girls tend to display higher self-management and social awareness than boys 
across all grade levels, though this gap narrows over time. Although (to our knowledge) this 
particular trend has not yet been captured in the literature across elementary, middle, and high 
school, this generally aligns with previous research finding that girls outperform boys in these 
competencies (e.g., Ablard & Lipshultz, 1998; Duckworth & Seligman, 2006; Gaspar et al., 2018; 
Kagesten et al., 2016; Moffitt et al., 2011; Pintrich & Zusho, 2002; Wentzel, 1994; Zimmerman 
& Martinez-Pons, 1990). 


Unlike self-management and social awareness, we found little difference in terms of 
growth mindset between female and male students, which corroborates some existing research 
(e.g., Macnamara & Rupani, 2017; Storek & Furnham, 2013; Tucker-Drob et al., 2016), even 
though some scholars have suggested that girls may be more likely to endorse a fixed mindset 
compared to boys (Dweck, 1986, 2000; Dweck & Simmons, 2014; Halvorson, 2011). Our results 
indicate that boys and girls report similar levels of growth mindset across elementary, middle, 
and high school—even as other SEL constructs develop differently. 


Indeed, trends in girls’ and boys’ self-efficacy are particularly striking; although girls 
report slightly higher self-efficacy in elementary school, their self-efficacy declines far more 
rapidly than that of boys in middle and high school, before recovering slightly in Grade 12. 


4 http://coredistricts.org/wp-content/uploads/2017/07/SEL 6.9.17.docx 
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Although prior studies have detected similar trends in middle school, they also suggest boys 
and girls display similar self-efficacy in elementary school (Anderman et al., 1999; Wigfield et 
al., 1991, 1996). Our results indicate that girls exhibit higher self-efficacy in elementary school, 
implying an even greater decline in self-efficacy for girls over time. In addition, conflicting 
findings in the field about gender differences may stem from the use of measures of global self- 
efficacy versus domain-specific self-efficacy (e.g., Pajares, 1996; Pajares & Graham, 1999; 
Roeser et al., 1996; Smith et al., 2002); our findings suggest that girls and boys display different 
trends even on measures of global academic self-efficacy. 


Socioeconomic status. For students from economically disadvantaged backgrounds, our 
findings corroborate the broad consensus in the field that students growing up in poverty 
display lower levels of SEL than their more advantaged peers, and that this trend persists over 
time (e.g., Bradley & Corwyn, 2002; Brooks-Gunn & Duncan, 1997; Kupersmidt et al., 1995; 
Takeuchi et al., 1991; Yoshikawa et al., 2012). However, notably, we find that SES-based gaps in 
SEL tend to narrow in high school, especially for self-management. Importantly, this narrowing 
does not reflect that students who are economically disadvantaged are more likely to drop out 
of high school prior to Grade 12, since our analyses include only students who were present in 
both years of survey data. 


Since family and community influences play a pivotal role in SEL (Eccles, 1999), these 
results suggest that schools, in particular, may have an opportunity to additionally support the 
development of social-emotional skills among students from economically disadvantaged 
backgrounds. Given that social-emotional skills are predictive of student’s academic 
achievement and other life outcomes (e.g., Almlund et al., 2011; Heckman et al., 2014), 
targeted interventions may help to alleviate the detrimental effects of poverty on students’ 
long-term well-being and success. 


Race/ethnicity. Both ESSA and California’s own Local Control Funding Formula (LCFF) 
require the disaggregation of student outcomes by race/ethnicity, highlighting the importance 
of understanding how SEL measures differ among students in these groups. In making such 
comparisons, however, it is important to keep in mind various factors that could lead students 
of color to respond to survey items differently than their White peers. Students of color are 
more likely to be economically disadvantaged and to experience trauma outside of school 
(Bolger et al., 1995; Chau, Thampi, & Wight, 2010; DeCarlo Santiago, Wadsworth, & Stump, 
2011; Hackman, Betancourt, Brodsky, Hurt, & Farah, 2012); these differences not only are risk 
factors for social and emotional health, but also may make it more difficult for students of color 
to demonstrate the kinds of behaviors asked about in the survey. Evidence from the CORE 
districts’ school culture and climate survey also reveals that students of color rate their school’s 
culture and climate less favorably than do their White peers, even when they attend the same 
school (Hough, Kalogrides, and Loeb, 2017); this is consistent with extensive research showing 
that students’ experiences within school differ by race/ethnicity, including well-documented 
disparities in disciplinary practices and expectations for success (Bankston & Zhou, 2002; 
Gregory, Skiba, & Noguera, 2010; Lareau & Horvat, 1999; Lewis, 2003; Okonofua, Walton, & 
Eberhardt, 2016; Tenenbaum & Ruck, 2007; Warikoo & Carter, 2009; Watamura, Phillips, 
Morissey, McCartney, & Bub, 2011). If these factors are considered when evaluating SEL data, 
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disaggregating the survey results by race can be useful in prompting educators and other 
stakeholders in schools serving diverse students to discuss how best to support students of 
color. 


Trends in students’ SEL over time look different for students of different racial and 
ethnic backgrounds, and depending on the construct of interest. We see that White students 
report higher levels of SEL consistently over time (although Asian students’ self-management 
closely mirrors that of White students). However, the size and trend of the gaps, as well as the 
group of students affected, vary depending on the construct. 


In general, across grades, African American students tend to report lower levels of both 
self-management and social awareness relative to other racial/ethnic subgroups. Similarly to 
the findings for socioeconomic disadvantage, gaps between racial/ethnic subgroups appear to 
widen in middle school but narrow in high school for self-management; however, the gap 
between White students and both Latinx and African American students increases over time for 
social awareness. 


In general, across grades, Latinx students report lower levels of both growth mindset 
and self-efficacy compared to other racial/ethnic subgroups overall. For growth mindset, the 
gap between White students and Asian, African American, and Latinx students narrows 
substantially from Grade 4 to Grade 12, with Latinx students particularly increasing in growth 
mindset between Grades 7 and 9. 


For self-efficacy, gaps among White, African American, and Latinx students do not 
change dramatically over time; for Asian students, however, this is not the case. Their self- 
efficacy initially increases in elementary school, but starts to decline in middle school and 
continues to plummet in high school, such that they report the lowest levels of self-efficacy by 
the end of high school of any racial/ethnic subgroup. This aligns with what Eaton and Dembo 
(1997) found, but provides some indication of how this self-efficacy gap may change across 
elementary, middle, and high school. 


Given the lack of empirical research explicitly examining differences in how students 
from various racial/ethnic student subgroups develop particular social-emotional competencies 
(Pintrich & Zusho, 2002), these results provide much-needed preliminary insights into these 
questions. However, there is still a lot more work to be done. For instance, it may be that these 
self-report surveys are written, structured, or administered in a way that consistently elicit 
different kinds of responses from students from different racial/ethnic backgrounds. In 
addition, the self-report nature of the measures may elicit different kinds of response patterns 
from different groups of students that might either mask or exacerbate gaps among student 
subgroups; for instance, White students may be more likely to inflate self-reported measures of 
SEL relative to students of other races/ethnicities. Ongoing research to examine these 
possibilities is therefore still needed. 


33] Trends in Student Social-Emotional Learning: Evidence from the CORE Districts 


Policy Analysis for California Education 
Os ———————————————————— 


Conclusion 


This paper has used the first large-scale panel survey of SEL outcomes to examine trends 
in students’ social and emotional learning across grades, and how those trends differ across 
student subgroups. We provide new evidence of the validity and reliability of student self- 
reports of social-emotional skills as measured by the CORE districts’ SEL survey, thereby 
contributing to a growing body of evidence about the appropriate interpretations and uses of 
these kinds of measures (e.g., Gehlbach & Hough, 2018; Loeb et al., 2018; Meyer et al., 2018). 
We also apply an innovative method for simulating cohort trends to estimate how students’ 
self-management, growth mindset, self-efficacy, and social awareness develop between grade 
4 and grade 12 among students expected to enroll continuously in the six districts participating 
in the survey in the 2014-15 and 2015-16 school years. 


We find that self-efficacy, social awareness, and, to a lesser degree, self-management 
decrease after Grade 6. These findings corroborate prior evidence that, unlike academic 
achievement, the development of students’ social-emotional skills does not proceed linearly or 
even monotonically over time (e.g., Schunk & Meece, 2005; Schunk & Pajares, 2002). However, 
growth mindset does appear to increase as students progress through school. These trends are 
critical for educators and policymakers to understand as they seek to make sense of patterns 
observed in their students. Declines across grades might not be alarming, but rather a sign of 
typical development. It may also be the case that the changes over time reflect changes in 
normative standards, rather than students’ underlying skills. For instance, self-efficacy may 
decline at least in part because younger students tend to overestimate their capabilities and 
become more realistic as they mature (Pintrich & Zusho, 2002). Moreover, the contrasting 
patterns observed for growth mindset compared to the other three constructs illustrate how 
different constructs within the SEL domain vary in their development over time, indicating that 
they should be measured and assessed individually. 


We also find that the development of social-emotional skills as measured by student 
self-reports varies across subgroups. Girls initially report higher levels of SEL than boys, but 
these gender gaps narrow over time, and girls experience a sharp decline in self-efficacy in 
middle school that leads them to lag behind boys on this construct through the end of high 
school; economically disadvantaged students consistently report lower SEL; and White students 
generally report higher SEL than Asian, African American, and Latinx students. These results 
suggest that schools may have an opportunity to additionally support the development of 
social-emotional skills among student groups who these data suggest are lagging behind. 
Nonetheless, it is crucial to keep in mind that there are many reasons these gaps might not 
reflect true discrepancies in social-emotional competencies. Given the limited evidence on how 
specific social-emotional skills develop over time for students from different backgrounds 
(Broda, et al., 2018; Eccles, et al., 1998; Good, Aronson, & Inzlicht, 2003; Walton & Cohen, 
2011), more work is needed to understand where particular subgroups are excelling and where 
they may need additional support at various points in their educational trajectories. The 
narrowing of racial and ethnic gaps with respect to self-management and growth mindset 
within the CORE districts is encouraging, but more research is needed to shed light on the 
interpretation of and factors contributing to those trends. 
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There are some important caveats to the findings presented here. First, although we 
find evidence of these measures’ reliability and validity, student self-report measures 
nonetheless have important limitations (Duckworth & Yeager, 2015). Self-report measures are 
susceptible to a range of possible biases, such as reference bias (West et al., 2016) social 
desirability bias (Paulhus, 1991). In addition, given the likely multi-dimensionality of the latent 
constructs underlying social emotional learning, self-report measures may capture only a 
specific aspect of a given social emotional competency. Second, we can follow the development 
of individual students’ SEL over the course of only a single school year; although we simulate 
cohort trends from Grade 4 to Grade 12, true longitudinal analyses would provide more precise 
estimates of development over time. Third, our specific findings are may not generalize to 
settings outside the California school districts in which the data were gathered. 


Nevertheless, the data from the CORE districts SEL survey provide a unique opportunity 
to assess students’ social-emotional development across elementary, middle, and high school, 
and the results suggest fruitful areas for additional research. As additional school systems 
gather data on SEL at scale, using either survey-based measures or alternative forms of 
assessment, it should become possible to learn whether the patterns we document are unique 
to the CORE districts or hold more generally. It is only by better understanding how SEL typically 
proceeds over the course of students’ educational careers that practitioners, researchers, and 
policymakers can begin to make sense of the patterns of SEL they see in their own data, for 
their own students. 
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Appendix 


Table A1: Descriptive Statistics for Matched Sample 


Grad | Grad | Grad | Grad | Grad | Grad | Grad | Grad | Grad_ | Total 
e4 e5 e6 e7 eg eg e 10 e 11 e12 


Male 50.7 50.3 50.1 50.3 50.0 50.7 50.4 49.3 49.1 

% % % % % % % % % 50.1% 
Asian 4.1% |5.0% | 7.7% | 8.3% | 7.8% | 7.6% | 8.2% | 8.9% |9.2% | 7.3% 
African 


American | 7.1% | 7.5% | 7.1% | 6.7% | 6.9% | 6.3% | 7.1% | 7.1% | 6.9% | 7.0% 


Latinx Wo3 |\734 | 710 69.9 | 706 | 73.7 - | 724 |) 720 | 706 

% % % % % % % % % 72.1% 
ELL 50.7 |49.9 | 43.1 | 344 |) 31.3 |) 265 | 23.3 | 186 | 17.8 

% % % % % % % % % 34.4% 
SWD 108 | 18 4s. | Tot | es 10.8 10.0 

% % % % % % 9.6% |9.2% |% 10.7% 
Econ Dis 78.5 | 77.4 |77.9 | 76.8 | 76.4 | 78.5 | 76.1 | 75.0 | 76.6 

% % % % % % % % % 77.1% 
Foster 0.8% |0.8% | 0.6% | 0.6% | 0.5% | 0.5% |0.5% |04% |0.4% | 0.6% 


Homeless | 1.3% | 1.9% | 2.1% | 2.4% | 2.6% | 2.1% | 2.4% | 1.9% | 1.8% | 2.1% 


Total 32,97 | 39,36 | 35,14 | 33,56 | 34,25 | 29,13 | 29,28 | 25,31 | 23,82 | 282,86 
Students 5 7 5 8 5 3 5 4 5 7 
Total 


Schools 529 714 379 210 265 259 237 229 225 1,033 
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